Entanglement Production in Non-Equilibrium Thermodynamics 
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We define and analyse the concept of entanglement production during the evolution of a general 
quantum mechanical dissipative system. While it is important to minimise entropy production 
in order to achieve thermodynamical efficiency, maximising the rate of change of entanglement is 
important in quantum information processing. Quantitative relations are obtained between entropy 
and entanglement productions, under specific assumptions detailed in the text. We apply these 
to the processes of dephasing and decay of correlations between two initially entangled qubits. 
Both the Master equation treatment as well as the higher Hilbert space analysis are presented. 
Our formalism is very general and contains as special cases many reported individual instance of 
entanglement dynamics, such as, for example, the recently discovered notion of the sudden death of 
entanglement. 
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INTRODUCTION 

Entanglement has been studied extensively in many 
body systems in the last five years or so A formal- 
ism has been developed to treat entanglement using the 
standard methods of statistical mechanics. Almost all 
of the studies have been focused on systems in thermal 
equilibrium, both at zero and finite temperatures. Real 
systems are, however, hardly ever in thermal equilibrium 
and at a fixed temperature. The field of non-equilibrium 
thermodynamics was developed in the decades between 
40s and 70s to deal with such driven systems and laws of 
their evolution 2]. 

Theoretical predictions of macroscopic entanglement 
have also been experimentally corroborated in systems 
such as, for example, grains of salt 3]. This raises a very 
interesting possibility, which I briefly speculated about 
sometime ago 4] , that entanglement can and does feature 
in living systems. Living systems, however, are composed 
of large macromolecules of various types and they exist 
at high temperatures (about 300 Kelvin plus). Can any 
entanglement survive under such harsh conditions? 

It would seem unlikely that macroscopic thermal en- 
tanglement could exist at 300K, but, it is very important 
to remember that living systems are not in equilibrium. 
They are in fact very much driven by their environments 
and continuously change in time. For example, chemi- 
cal reactions in the cell's mitochondria are very far from 
equilibrium, which is why they can produce and sup- 
ply energy necessary for cell's functioning. It is feasible, 
therefore, that a system's equilibrium state is not en- 
tangled, while, for the same system, entanglement gets 
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created when this system dynamically approaches equi- 
librium. Steady states of driven systems could also eas- 
ily be engineered to be entangled. Achieving coherence 
away from equilibrium is nothing unusual after all: the 
phenomenon of population inversion is one such instance 
and it has been speculated that the coherent electron 
transport in cell membranes (as well as photosynthesis) 
functions in a similar way Q . 

Bio-chemical experiments are now approaching the ap- 
propriate levels of sophistication where quantum features 
of energy transfer processes can be addressed in greater 
detail. Remarkable recent results show that quantum 
coherence, in the form of quantum energy beats, is 
present in the energy transfer process in photosynthe- 
sis at T = 77 K 0. The authors compare their findings 
to a version of Grover's search algorithm where the 
incoming light excites a number of energy states in the 
receptors, which then coherently (and rapidly) transfers 
energy to the most convenient storage state. The authors 
also do not rule out the possibility of non-local effects, i.e. 
entanglement, though their experiment was not designed 
to reveal any such phenomenon. 

Studying entanglement in real systems, especially bio- 
logical ones, impels us therefore to phrase the whole ques- 
tion of the existence of many-body entanglement within 
the formalism of non-equilibrium thermodynamics. The 
central quantity in thermodynamics is entropy. Whether 
a certain thermodynamical state can be transformed into 
another one is determined by the difference between their 
corresponding entropies. But, thermodynamics does not 
tell us how exactly the transformation is to be executed - 
despite its name, the details of dynamics are not part of 
thermodynamical description. Dynamics of macroscopic 
objects immersed in noisy environments belongs to the 
domain of non-equilibrium thermodynamics. 

The central quantity in non-equilibrium thcrmody- 
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namics in not entropy, but the rate of change of entropy, 
which is known as entropy production 0, [§]. This is 
perhaps not surprising, since dynamics should be de- 
scribed by rates of change of relevant kinematic quan- 
tities and entropy is one such quantity. Here, however, 
our intention is to study behavior of entanglement in non- 
equilibrium and we therefore introduce a quantity we call 
entanglement production. The main aim of this work 
will be to compare the behavior of entropy and entan- 
glement productions under very general dissipative evo- 
lutions. The hope of the author is that the entropy pro- 
duction in some way constrains the rate of entanglement 
production. This would be a completely novel contribu- 
tion to the study of connections between entanglement 
and thermodynamics . Our approach is important not 
only in the domain of studying macroscopic quantum 
physics, but may also be able to shed some new light 
on the issues related to the quantum measurement (see 
0). 



ENTROPY PRODUCTION 

We begin by analysing the following question. A 
system, whose Hamiltonian is H, is in contact with a 
heat bath which interacts with the system driving it 
into the equilibrium thermal state pT — e^^^ /Z where 
Z = tre^^^ is the partition function. Note that here 
H will be time independent; however, entropy produc- 
tion can be defined for driven systems as well and most 
of what we have to say will apply to these more general 
circumstances. We will point this out whenever appro- 
priate as we proceed in our argument. If the system is at 
the beginning in some state p, we ask about the entropy 
change during the process in which this state thermalises. 

There are two components to the total entropy change 
U, [13], AS't, which are usually written as ASt = 
ASint + ASext- The first term signifies the internal 
entropy change, which is the change of system's en- 
tropy, given by ASint = S{pt) — S{p), while the sec- 
ond term, the external entropy change, is ASext — 
^J2k rkitrprH ~{rk\H\rk))/T = tr{pT-p) InpT, where 
p = rk\rk){rk\ is the eigen-decomposition of the den- 
sity matrix. This term signifies the entropy increase in 
the environment. It is derived by calculating the (ex- 
pected) heat transfer from the system to the environment 
divided by the temperature. The total entropy change is, 
therefore, conveniently expressed using the relative en- 
tropy as 



in time, like so 



AS't = S{p\\pt) = tr{pln p - pin pt) 



(1) 



This quantity is never negative which is an expres- 
sion of the second law of thermodynamics. If we look at 
the continuous change of entropy in time, a naive way of 
thinking would suggest to us that the entropy produc- 
tion, a(t), should be given by a derivative of the above 



4ASt 
dt 



'tr{— p){ln p~ In pt) 



(2) 



The negative sign corresponds to the fact that, while the 
relative entropy generally decreases in time, the entropy 
production itself should be a positive quantity. Remark- 
ably, upon a more rigorous investigation, this turns out 
to be the correct expression for entropy production 
Since p describes the most general evolution of an open 
system, its (continuous) dynamics is given by the Lind- 
blad master equation which has the following general 
form (^i = 1) Q: 



1 1 

p^-[H,p]--j2{^inp+pTirk 

k=l 



2rfcpri}, (3) 



where the dot represents the time derivative, and F's 
are the dissipative operators. They do not need to 
satusfy any special requirements, since the combina- 
tion through which they enter the Master equation al- 
ready guarantees the "physicality" of the whole process. 
Namely, for a small time interval At, we can describe 
the time evolution of the density matrix by the follow- 
ing completely positive, trace preserving map (CP-map), 
p{t + At) « J2l^oWkpit)Wl, where Wq = l-iHAt and 
Wk = VAtTk {k £ {1 . . .n}) are called the "no-jump" 
and jump operators respectively. H is a non-Hermitian 
Hamiltonian, given by: H — H — ^Y^2=i^k^k- Note 
that the operators Wk fulfill the completeness relation 
J2k=o^k^k — 1- Because of the non- increase of the 
relative entropy under general CP-maps [l3| , we can also 
conclude that ct > holds in general (thereby justifying 
our insertion of the minus sign in the above definition). 

For completeness, it should be stressed the entropy 
production rate can be defined even when we do not 
have stationary states of our evolution. The derivation 
here followed the assumption that the state of the system 
thermalises due to its interaction with the environment, 
but even outside of this framework - and we mentioned 
driven systems earlier - the concept of entropy production 
is still very much meaningful. Since in this paper most 
of our attention will be devoted to dissipative evolutions 
leading to thermalisation, our above considerations will 
be sufficient, but it is by all means worth noting that the 
generality of the concept of entropy production stretches 
far beyond what we have presented. 

Thermodynamically the most efficient processes are 
the reversible ones, where cr = 0. A state of the sys- 
tem must then be transformed by being in touch with 
(a sequence of) reservoirs whose state is only infinitesi- 
mally different to that of the system. Then, the relative 
entropy between the system and the reservoir is zero up 
to the second order, S{p + dp\\p) « 0. Thermodynamical 
efficiency, however, may not be the desired goal when we 
are optimising the computational speed-up, as we do in 



3 



quantum computation. Then, a far better indicator of 
efficiency is the rate of consuming or creating entangle- 
ment (whether we do the former or the latter depends 
on the model of quantum computers we use, but this dis- 
tinction is of little importance here) . We now proceed to 
define it. 



ENTANGLEMENT PRODUCTION 

The first important point to mention is that when a 
system interacts with its environment, there are many 
different entanglements that we can consider. For in- 
stance, there is the entanglement between the system 
and the environment that develops as the evolution, in 
the form of their interaction, proceeds. Secondly, there 
is the entanglement within the environment itself, which 
could be very complex. In this paper, however, we are in- 
terested in the amount of entanglement within the system 
only. Much as the entropy production refers to the en- 
tropy production by the system, so will the entanglement 
production be strictly confined to within the system. 

Given this, there is still a myriad different expressions 
for the amount of entanglement in a given quantum state 
p [lit . However, since the relative entropy is involved 
in quantifying the entropy production, we will also use 
the relative entropy to measure entanglement [3, \vh^ . 
Another advantage of this measure is that it is universal, 
applying as it does to any number of subsystems of any 
dimensionality 15|. We define entanglement production, 
ge, to be the temporal derivative of the relative entropy 
of entanglement. Thus, 



'yE = j^s{p{t)\\p,,p{t)) 



(4) 



This can be easily rewritten as <te — tr{p In p— expjln p— 
\ii Psep}psep}, highlighting the difficulty that, unfortu- 
nately, exists in computing the last term, psep- This is 
because the closest separable states changes in time with 
p and we need to calculate it at each instant in time. 
Ignoring this difficulty for the moment (for this already 
exists when calculating the relative entropy of entangle- 
ment itself [IH), let us first analyse the general relation- 
ship between entropy and entanglement productions. 

How do we expect a and as to be related, given our 
knowledge of dissipation and entanglement? We would 
most likely conjecture that the rate of entropy production 
is in absolute sense always greater than that of entangle- 
ment production. The reason is that we can easily imag- 
ine a situation where the steady state is disentangled, and 
therefore cte = 0, but the entropy is still produced, i.e. 
CT > (see for example [ll]). But, does this hold more 
generally? This simple answer is no, since we can con- 
struct a state very weekly coupled to its environment, 
so that the resulting entropy production is very small, 
but that its (state's) internal dynamics is so strong that 



entanglement gets rapidly generated. Since the rate of 
internal dynamics is (seemingly) completely independent 
from the coupling rate to the environment, this differ- 
ence between the entropy and entanglement productions 
can be made as large as we please (this is not quite cor- 
rect since both the driving and dissipation may depend 
on the same features, but we will not go into details of 
this here [l3|)- What if, on the other hand, the system 
is only evolving entanglement due to the environmental 
coupling (i.e. without any other external driving)? 

To investigate this, let us now assume a special case 
where psep (t) = pr at all times (we will encounter a con- 
crete example of such a system later). Then, dpsep/dt = 
0, and so aE{t) + cr{t) = 0. In this case entanglement 
decreases by exactly as much as the entropy increases at 
each instant in time. Since we know that entropy pro- 
duction is always positive (this is a restatement of the 
Second Law), the above equation implies that entangle- 
ment is being reduced. All the dissipation is therefore 
used up solely in destroying entanglement. In general, 
however, this is not necessarily the case. The separable 
state will in general evolve during the dissipative evo- 
lution and the above law no longer holds. What then 
is the function of the excess of entropy production over 
entanglement production? 

Before we address this issue, it is interesting to mention 
Prigogine who showed that under some restricted 
conditions, a principle of the minimum entropy produc- 
tion can be derived (for details see We hear it fre- 
quently stated that biological processes conform to this 
rule, which in our above case would imply the principle of 
minimum entanglement destruction. It is fascinating to 
explore further if the efficiency of some natural processes 
simply derives from the maximal possible preservation of 
entanglement during the time of these processes. (Might 
the same be true for general quantum computational pro- 
cesses?). 

We argued that it is clearly feasible to have a finite 
entropy production while at the same time not have any 
entanglement dynamics. A steady state of a driven sys- 
tem displays this feature as we noted before, but so does 
the recently experimentally confirmed 12 1| phenomenon 
of the "sudden death of entanglement" [24] . In the latter 
case, the system dissipates toward a disentangled steady 
state, but entanglement vanishes before this steady state 
is reached. Beyond this point, it is clear that aE = 0, but 
entropy is still produced until the steady state is reached. 

The opposite of this cannot happen, namely the fact 
that entanglement is produced but entropy is not, pro- 
viding that the system is not driven. If the system is not 
driven, the entropy production is zero only in thermal 
equilibrium, but then so is entanglement production. It 
is therefore natural to conjecture that, if we eliminate the 
possibility of driven entanglement, then |(T£;| < a. We use 
the absolute value of entanglement production because 
we do not want to worry about whether entanglement 
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increases or decreases. We would only like to claim that 
the change in entanglement is bounded by the change 
in entropy. This question resembles the question of Lan- 
dauer's erasure [23|, namely whether the entropy increase 
in the environment during a measurement is greater than 
the information obtained during the same measurement. 
In order to address the question of entanglement produc- 
tion in a more quantitative way, we now utilise a different 
way of presenting dissipative evolutions. 



HIGHER HILBERT SPACE VIEW 

Any completely positive map of the above type can be 
represented in a fully unitary way providing we are al- 
lowed to include the environment in the treatment of the 
dynamics. At this global level of the system and environ- 
ment, the dynamics is strictly unitary (since their aggre- 
gate is closed). Where does entropy production come 
from then, when unitarity strictly preserves entropy? 
The answer is that it is generated by neglecting the cor- 
relations between the system and the environment 24 1. 
We will see this in our examples below, but for now let us 
imagine that the initial state of the system and environ- 
ment is uncorrelated, psPE- Suppose that after the uni- 
tary interaction the state is ps'E> (primes will always per- 
tain to the evolved state) . It is true that due to unitarity 
S{psPe) = S{ps>E'), however, if we separate the system 
and environment then, due to subadditivity, S{ps'E') < 
S{ps') + S{pe')- Therefore, if we disregard the correla- 
tions, we have that S{ps)+S{pe) < S{p'g)+S{p'^) and so 
ASt = ASs+ASe = Sip's)- Sips)+S{p'E)+S{pE) > »• 
A way of explaining the entropy increase from a unitary 
evolution lies therefore in neglecting correlations (this 
is probably the most accepted view of "deriving" irre- 
versibility from the microscopic reversibility). 

I would like to make a simple point here that is well 
known, but may be worth discussing briefly. It is this. 
The view that the deletion of correlations is responsi- 
ble for the entropy increase is very closely related, if 
not identical, to the "coarse graining" method of ex- 
plaining the entropy increase (that originated in classical 
physics). The coarse graining argument goes as follows. 
Any Hamiltonian evolution (be it quantum or classical) 
preserves entropy and is incapable of explaining its in- 
crease. However, if we calculate the entropy with re- 
spect to some underlying structure (known as the coarse 
grained version of phase space in classical physics), then 
this relative entropy between our state and its coarse 
grained version will always increase. Here, it is the ne- 
glect of the underlying microscopic structure that is re- 
sponsible for entropy increase and the relative entropy 
again becomes a prominent measure of the "amount of 
neglect". It turns out, furthermore, that the relative en- 
tropy between the quantum state pab and its marginals 
PaPb is just equal to the mutual information of AB, 



S{pa) + S{pb) — S{pab) UM- And, we have seen that the 
"flow" of relative entropy, unlike that of ordinary entropy, 
is always unidirectional when we have the most general 
CP evolution. It is this change in relative entropy that is 
used to quantify the entropy production. It is thus im- 
material whether we use the mutual information or the 
relative entropy of coarse graining to measure the entropy 
increase - they should ultimately be the same. 

Suppose, following this logic, that our system S now 
contains two subsystems A and B. The initial state of 
the system and envorinment is, as before, pabPe- The 
evolution is given by UabePabPeUI^be == PA'B'E'- We 
can now apply the strong subadditivity 25] to the fi- 
nal state to obtain Sa'B'E' + Sb' < Sa'B' + Sb'E'- 
Since Sa'B'E' ~ Sabe ~ Sab + Se, we have that 
ASab + ASe > Sb' + Se' - Sb'E' = I{B',E'), which 
means that the entropy increase due to separation is big- 
ger than the mutual information between either of the 
subsystems and the environment (see pij for a more gen- 
eral discussion of the thermodynamics of measurement 
information). We have shown previously that, under 
quite general circumstances, the change in the mutual 
information between environment and the system is an 
upper bound to the change of entanglement. (Similar 
considerations were presented in [231 where the authors 
show that the amount of work needed to erase all cor- 
relations in a state is equal to its mutual information). 
Following through the above inequality this would imply 
that ASab + ASe > AEab', this, inequality, however, 
still remains a conjecture, although we have presented 
strong "circumstantial" evidence in its favor. 

The issues related to entropy and entanglement pro- 
ductions have been very general so far, and hold for any 
kind of physical system independently of its size, number 
of degrees of freedom and such. From now on, however, 
we will specialise to the evolution of two qubits under 
the influence of dephasing and dissipation. These are 
two very common mechanisms leading to thermalisation 
which is why they are of particular importance. We hope, 
however, that our considerations will, in the future, be 
extended to many body systems, where - as we already 
indicated in the introduction - many interesting and fun- 
damental questions are to be found (for a review see [H). 



EXAMPLES: DEPHASING AND DISSIPATION 

Suppose that systems A and B are two entangled 
qubits initially in an entangled state \'^ab = a\00) + 
6 1 11). Here the relative entropy of entanglement is 
Eab = —a^ Ina? — In 5^ (We assume a, b to be real for 
simplicity and normalised + b^ = 1). There are many 
way of destroying this entanglement, but the two most 
common ones are through dephasing or decay. Imagine 
that one of our qubits is coupled to an environment lead- 
ing to a dissipative evolution. At the Master equation 
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level, this can be written as 

d-P ^ I 1 7 /r - +1 r - +1N 

where af are the usual Pauli matrices (instance of the T 
matrices in the general formulation) and ^,K,ri > are 
decay rates. The first term describes the free qubit evolu- 
tion under H = ujOz (with lo being its natural frequency) , 
the second and third terms are the decay ones (in both di- 
rections of exciting and de-exciting the qubit), while the 
last term indicates the dephasing process. Here we have 
assumed that only one of the qubits interacts in this way 
with its environment, while the other one remains sta- 
tionary. This restricted assumption is immaterial to our 
discussion. We could easily have included the evolution 
of the other qubit without any fundamental modification 
to the forthcoming conclusions. 

It is straightforward to compute the overall state evo- 
lution under this Master equation, 

/ a{t) [i{t)ah \ 
, , 

P\i) - 

\n{t)ab l-a{t) J 

where fi{t) = exp{— iwt — {l/2){-f + k + r/)t}, a{t) ~ 
5{t)a^ + 5'{t), S{t) ^ exp(-(7 + K)t), and S'{t) = (7(1 - 
exp(— (7 + K)t)))/{K + 7). The stationary state of this 
evolution is obtained by letting t ^ 00, while the closest 
separable state at any instant in time is given by delet- 
ing the off-diagonal elements, i.e. by setting /i = in the 
above density matrix. These allow us to compute both 
the entropy as well as entanglement productions. The 
expressions are simple but cumbersome to write down; 
the difference between entropy and entanglement produc- 
tions is: a — IctbI — a{t) ln(l — a{t))aoc/{a{t){l — floo)), 
where aoo = linit^oo a{t). It can be proved that this is a 
positive quantity (thus supporting our conjecture) that 
decays at the rate e"*^ Note that the off-diagonal 
decay does not play any role in this formula, although, 
of course, it is the reduction of the off-diagonals that 
contributes to thermalissation (and thereby it features 
in both entropy and entanglement productions individu- 
ally). 

We can now investigate the process of dephasing on 
its own, but to make it clearer we will undertake this 
from the higher Hilbert state picture. We have that 
K = 7 = and T] > 0. Dephasing is obtained 
through the following interaction between {AB) and E, 

(IOaOb) + |U1b))|0£;) ^ \OAOB)\aE) + \lAlB)\bE), 

where (a£;|6_E) = 1 — riSt > 0. Suppose that the same 
interaction happens in each small time step St = t/k, 
where t is the total time of evolution. Then, after k such 



steps we obtain, 

IOaOs) las) lap) - law) + lbs) Ibp) - |M 

v ' " V ' 

k k 

But now {aE\bE) {o-F\bF) ■■■ {o-N\bN) = (1 - rjt/k)'' 
exp(— lyt) as fc — * 00. The final state of the system 
AB, when the environment is traced out, is the mixture 
1 00) (00 1 + |11)(11|, which is exactly the same result as 
that obtained from the Master equation treatment above. 
This is not an accident; this way of treating the dephas- 
ing is equivalent to the two assumptions used in deriving 
the Master equation, the so-called Born and Markov ap- 
proximations. The former ensures that during each step, 
St, the interaction with the environment is weak (i.e. r]St 
is "small"), while the latter effectively corresponds to a 
memoryless environment (each new interaction is with 
a different environmental subsystem). In this case the 
state of AB becomes mixed as i — > cxd and contains no 
entanglement. Quantum correlations have thus been de- 
stroyed, but the classical ones still remain. Note that 
the closest separable state throughout the evolution is 
always the same and it is equal to the final state reached 
as fc — > 00. 

An interesting aspect of this treatment is that the mu- 
tual information between the system and environment, 
whose total state is pure, is twice the value of the en- 
tropy of the state, and, twice the value of the reduction 
of entatanglement. This seems to represent a contra- 
diction in the light of the previous claim, namely that 
when the thermal and separable state coincide, then the 
entanglement reduction should be equal to entropy pro- 
duction. However, the environment in this example was 
pure to start with. In order to recover the equality of en- 
tropy and entanglement rates, we need to start with an 
already mixed environment (many identical subsystems, 
all completely dephased). Then, through the interaction 
with the system, dephasing will be achieved whose to- 
tal entropy increase will exactly match the entanglement 
decrease. This shows that a more appropriate way of 
looking at dephasing is through the process of thermali- 
sation as presented in [2§]. 

CONCLUDING DISCUSSION 

Here we have introduced the notion of entanglement 
production, in direct analogy with the quantity called en- 
tropy production. The latter has been used extensively 
in the studies of non-equilibrium thermodynamics lead- 
ing to fundamental and profound insights in chemistry 
and biology [13] ■ We have shown that the two quanti- 
ties are closely related, and have presented evidence for 
the fact that entropy production presents a bound on the 
rate of change of entanglement during general dissipative 
processes. 
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There are many open question of general nature im- 
plied by our work. For instance, is there an entangle- 
ment "balance" equation of the type dE/dt — cTE + '^jE, 
where Vj^; would be the entanglement flux of entangle- 
ment through the boundary between the system and its 
environment? It is clear that this can be answered in 
the affirmative in the case when aE = cr, since entropy 
production satisfles a balance equation, but does it hold 
more generally? 

While entropy is important in describing the direction- 
ality as well as the speed of thermal processes, entangle- 
ment and the rate of its change are important when we 
discuss the capacity of the system for quantum informa- 
tion processing. One wonders, for instance, if the efli- 
ciency of one way quantum computers relys on a delicate 
balance and trade-off between entropy production gen- 
erated by measusments and the entanglement reduction 
during computation 31[. In a broader context, since we 
are discovering more and more rapidly that natural pro- 
cesses exploit quantum effects to enhance their efficiency, 
studying general principles behind dissipative entangle- 
ment production appears to be a very important and 
worthwhile venture. 
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